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Abstract 

We find the value of constants related to constraints in characterization of some 
known statistical distributions and then we proceed to use the idea behind maximum 
entropy principle to derive generalized version of this distributions using the Tsallis' 
and Renyi information measures instead of the well-known Bolztmann-Gibbs-Shannon. 
These generalized distributions will depend on g G M and in the limit q ^ 1 we obtain 
the "classical" ones. We found that apart from a constant, generalized versions of 
statistical distributions following Tsallis' or Renyi are undistinguishable. 



Introduction 

The development of statistical mechanics and its application to a wide variety of physical 
phenomena take a leap forward with the works of Shannon [17] and Jaynes [8, 9]. Before 
that, the usual line of reasoning was to construct the theory based on the equations of 
motion, supplemented by additional hypotheses of ergodicity, metric transitivity, or equal 
a priori probabilities and the identification of entropy was made at the end by comparison 
of the resulting equations with the laws of thermodynamics. 

The point of view developed by Shannon and Jaynes took the concept of entropy to 
play a central role. In this modern approach, the fact that a probability distribution max- 
imizes the entropy subject to certain constraints becomes essential to the justification of 
the use of that distribution for statistical inference. By freeing the theory from apparent 
dependence of physical hypotheses they made its principles and mathematical methods 
to become available for the treatment of many new physical problems. The constraints 
used to maximize the entropy are interpreted as the real unbiased knowledge about the 
system (as the mean energy, mean number of particles, etc) with the additional restriction 
of normalization of the probability distribution over the entire value range of the state 
variable. This is sometimes referred as the Maximum Entropy Principle (MEP)[8, 9]. 
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The Boltzmann-Gibbs entropy, usually referred as the Boltzmann-Gibbs-Shannon entropy 
(we only write its continuous form): 



has been at the basis of invaluable scientific results in physics, chemistry and elsewhere. In 
particular, the results are very well known for the treatment of equilibrium thermodynam- 
ics in systems composed of many independent subsystems where the entropy of individual 
independent parts are additive ad the entire systems has ergodic stationary states. 

In order to handle with non equilibrium states in systems with a complex behavior (typi- 
cally nonergodic), C. Tsallis proposed the entropic functional: 



which is, in some sense, a generalization of the former entropic functional because in the 
limit for the Tsallis entropy g — > 1, we obtain again the Boltzmann-Gibbs-Shannon (BGS) 
entropy. The index q has been interpreted as a degree of non extensivity which accounts 
for the case of many non independent or long-range interacting systems [18]. 

The probability distributions obtained by maximization of this entropic functional with 
appropriate constraints with g 7^ 1 yields a correct description for different classes of sys- 
tems: those with long range interactions and those with fluctuations of temperature or 
of energy dissipation. Examples cover a wide range of applications from hydrodynamic 
turbulence [1, 3, 4], scattering processes in particle physics [2], self-gravitating systems is 
astrophysics [16] to anomalous diffusing micro-organisms [20], classical and quantum chaos 
[21, 14], economics [5] and others [18, 19]. Tsallis' formalism seems to be more general 
than BGS and there are reasons to believe that the Sq is the proper physical entropy for 
generalizing the BGS formalism. In any case the BGS entropic form is obtained from the 
Tsallis one in the limit g — > 1. There are still other entropic forms like the Renyi one 
which has the property of being additive for independent systems. 

It is well known that probability distributions plays a central role in statistical theories 
because they are the mathematical models of certain phenomena under analysis. Known 
distributions such as Normal, Log-Normal, Exponential, or Cauchy can be derived by 
maximization of the BGS entropy with appropriate constraints along with the usual nor- 
malization condition Jjp{x)dx = 1 where / vary accordingly and x is a continuous random 
variable with distribution p(x). The constraints are identified with moments of order n > 1 
of the distribution. [7, 10, 12, 13]. 

So it will be interesting to see if using the same idea behind the maximization of the 
entropy we can obtain generalized versions of some of known probability densities by re- 
placing both the entropic functional and the constraints, chosen in a convenient manner. 
This paper revisit the idea in [7] and we find the values of undetermined constants that 
appear related to constraints with BGS formalism. Then we find the generalized versions 
of the same statistical distributions by replacing the BGS entropic functional with Tsallis' 
and Renyi measures. In cases where logarithmic and exponential functions appear, they 
are replaced with its generalized versions as defined in [11, 15]. 
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1 Characterization of continuous "classical" distributions 

Maximum entropy principle states that the least-biased description that can be devised 
on the basis of some specific data is that which maximizes the thermodynamical or BGS 
entropy n]. Using this idea, characterization of statistical distributions via MEP is ob- 
tained when one maximizes the BGS entropy with some constraints (which not necessarily 
represent observable quantities) along with normalization condition. So, the statement of 
the problem is: "let X be a continuous random variable with x G I and probability density 
p{x) on /. Let the entropy be given by: 

S = - j p{x)\np{x)dx {BGS) (1.1) 

where p{x) is consistent with N constraints conditions fk {x,p{x)) ,k = 1 . . . N and with 
the normalization condition on /, Jjp{x)dx = 1. Then the least-biased p{x) is that which 
maximizes S*: 

N 

S* = S-Xo p{x)dx - V Xkfkix^x)) (1.2) 

where are the Lagrange multipliers". 
1.1 Uniform Distribution: J = (0, 1) 

In this case the only constraint is the normalization condition, then we need to maximize: 

S* = S — Xq / p{x)dx giving : 







p{x) = e-(i+^) = ]- 

For any bounded subinterval of (0, 1), ((a, b) C (0, 1)) where p{x) is given we have: 

/ p{x)dx = I p{x)dx = —{b — a) = 1 /. A = b — a 
Jo J a A 

Then the uniform distribution is : 

p{x) = Vx G / (1.3) 

b — a 

1.2 Exponential Distribution: / = (0, oo) 

The constraints are: 

1. p{x)dx = 1 2. xp{x)dx = m 
Then we need to maximize: 

roo roo 

S* = S — Xo / p{x)dx — Xi xp{x)dx, giving : 
Jo Jo 

p{x) = Coe~^i^ where Cq = g-^^+^o) 
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Applying condition 1 we obtain Cq = Ai with Ai > and applying condition 2 we obtain: 

f°° 1 
/ xp{x)dx = — = m 
Jo -^1 

Then the exponential distribution is: 

p{x) = me~™^; m > \/x e I (1.4) 
with m being the mean value of x under the exponential distribution. 

1.3 Gamma Distribution: / = (0, oo) 

The constraints are: 

1. p{x)dx = 1 2. xp{x)dx = gi 3. ln{x)p{x)dx = §2 
Then we need to maximize: 



S* = S — Xq / p{x)dx — Ai / xp{x)dx — A2 / \a{x)p{x)dx 
Jo Jo Jo 

then p{x) = Coe~^'''x-^^ where Cq = e~(^+^o) 

Applying condition 1 we get '^"fi"'^ = 1 with w = 1 — A2 > 0. Applying condition 2 and 
3 we get ffi = XT 52 = — InAi. So, the Gamma distribution is: 

AUAix^e , ^^^^ ^^^^ 

r(7i;) 

1.4 Log-Normal Distribution: / = (0, 00) 

The constraints are: 

1. p{x)dx = 1 2. Jq°° ln(a;)p(a;)(ix = 3. \v?{x)p{x)dx = a"^ 
And we need to maximize: 

S* = S — Xq I p{x)dx — Xi / ln(x)p(x)(i2; — A2 / lii^ {x)p{x)dx 



then = Cox~^ie^^2in2(x-) ^^/^g^g ^ ^_(i+Ao) 



Assuming Ai = 1 and applying condition 1 we get Co = y/X-z/TT and applying condition 2 
and 3 we get A2 = l/2cj^. So, the Log-Normal distribution is: 



1 / In^ X 
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1.5 Normal Distribution: / = (— oo, oo) 

The constraints are: 



X = a 



We need to maximize: 



S* = S — Xq / p{x)dx — Ai / xp{x)dx — X2 x'^p{x)dx 



then p{x) = Coe ^^""e' 



00 

'22 



w 



here Cn = e'^^+^o) 



Assuming Ai = and applying condition 1 we get Co = yX^/T^ and applying condition 2 
and 3 we get A2 = 1/2(T^. So, the Normal distribution is: 



p(x) = -i=exp(-^) VxG/ 



1.6 Laplace Distribution: I 

The constraints are: 



-00, 00 J 



(1.7) 



I. j°°^p{x)dx = I 2. j^^\x\p{x)dx = w 
We need to maximize: 

/oo /'OO 
— Ai / 
-00 J —00 

p{x) = Coe-^il^l where Co = e-^^+^o) 

Applying condition 1 we obtain: Cq = Ai/2 and applying condition 2 we get: w = 1/Ai, 
so the Laplace distribution is: 



p{x) 



^e-Ai|x| 



with 



Ai G 



(1- 



2 Characterization of continuous "generalized" distributions 

In this section we derive generalized statistical distributions by replacing the BGS entropy 
measure with Tsallis and Renyi measures: 



1 



q-1 



1 



Sr 



1 



In 



p'^{x)dx 
p'^{x)dx 



(Tsallis) 
(Renyi) 



(2.1) 
(2.2) 



and we use generalized logarithms [15] instead of natural logarithms. The generalized 
statistical distributions will give, in the limit g — > 1, the corresponding "classical" ones, in 
a same way as the Tsallis and Renyi entropies give the BGS entropy when g — > 1 so, the 
statement of the problem remains the same. 
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In order to obtain the generalized distributions it is necessary to apply partial derivatives to 
Tsallis and Renyi measures. This derivatives have the same structure, the only difference 
being a constant factor appearing in Renyi derivative, namely Jj p'^ {x)dx: 



dS„ 



pp ^{x)dx 



dp{x) 



dp{x) q — 1 J I 



So, in what follows, we use only the Tsallis measure to obtain the generalized densities 
p{x) and the "escort" probabilities defined as: 



p'^{x) 



(2.3) 



/ p'^{x)dx 

2.1 Generalized Uniform Distribution: / = (0,1) 

In this case the only constraint is the normalization condition, then we need to maximize: 

I / p'^{x)dx giving : 
Jo 

"Ao(l-g) 



p{x) 



1 

q-1 



c 



For any bounded subinterval of (0, 1), ((a, b) C (0, 1)) where p{x) is given we have: 

\iix)dx = C'' f dx = C'i{b-a) 

J a 

Then the uniform distribution and the escort probabilities are: 

"Ao(l-g)" 



Pesc(,x) 



p{x) = 

pi{x) C" 1 



1 

q~l 



c 



j pi{x)dx Ci{b-a) b 



Vx G / = (0, 1) 



(2.4) 
(2.5) 



2.2 Generalized Exponential Distribution: / = (0, oo) 

The constraints are: 

1. p{x)dx = 1 2. xp'^{x)dx = m 
Then we need to maximize: 

/■oo f'OO 

S* = Sq — Xq / p{x)dx — Xi xp''{x)dx, giving : 
Jo Jo 

"Ao(l-g) 



p{x) = C[l + {q- l)Xix] 9-1 where C 



1 

9-1 
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Applying condition 1 we obtain: 



1 = lim 



C 



C^oo Ai(g-2) 

which converges only if 1 < q < 2 for q G 
Applying condition 2 we obtain: 



■ 9-2 

i~ - 1 



c 



Ai(2 



m 



x]fi(x)dx = C 



xdx 



10 Jo [1 + (g - l)Aix]9-i Ai 

Then the exponential distribution and the escort probability are: 

Ai(2-g) 



p{x) 



[l + Xliq-l)x] 



VxG/=(0,oo), qe{l,2) 



9-1 



p'^ix) 



A?(2-g)^-i 



jpi{x)dx + 1)2;]^ 
Is easy to verify that taking limit in Pgsc we get: 

A?(2 



^q-l 



lim 



Ai e 



-Ai X 



'i^^ [I + \l{q - l)x\~ 
which is the exponential distribution. 

2.3 Generalized Gamma Distribution: / = (0, 00) 

The constraints are: 

1. p[x)dx = 1 2. xp'^{x)dx = gi 3. lnq{x)p'^{x)dx = §2 
Then we need to maximize: 



S* = Sq — \q j p{x)dx — Ai / xp'^{x)dx — X2 liiq{x)p'^ {x)dx 
Jo Jo Jo 

1 



then p{x) = C[{q — l)Xix + X 9-1 where C 



(2.6) 
(2.7) 



with A2 = 1. Assuming that in the final expression for p{x) the limit exists, we will take 
the limit inside the integral when applying the conditions: 



poo POO 

1 = lim / p{x)dx = / lim p{x)d2 
9^1 Jo Jo 



Applying the second condition and using the last limit we get: 



lim [2;p'^(x)] dx = — = gi 
Ai 
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The third condition gives: 
Hm 



lnq{x)p'^{x)dx 



oo 

hm p'^{x) 





l-Q 



dx 



(2.8) 



C / xln(x)e-^i^(ix = C 



1 - 7 - In(Ai) 
A? 



1 - 7 - In(Ai) = 52 



where 7 is the constant of Euler-Mascheroni defined as: 



/ e-"ln('u)(iu = -r'(l) 



Then the generahzed Gamma distribution and the escort probabihties are the same: 



-Pesc(^) 



p'^(x) 



[\ix{q-l) + 



.1-91- 



(2. 



/o°° p'^{x)dx 

VxG/=(0,oo), gG(l,2) 

Taking hmit in this last expression we get the Gamma distribution for w = 2 (see 1.5): 

p{x) = xA? e-^i^ 

2.4 Generalized Log-Normal Distribution: I = (0, 00) 

The constraints are: 



1. /g°°p(2;)(ix = 1 2. lnq{x)p'^{x)dx = 3. ln'^{x)p'^{x)dx 



And we need to maximize: 

/■oo 

-Sg = S'g — Ao / p{x)dx — Ai / lnq{x)p'^ {x)dx — A2 / lni{x)p'^{x)dx 



then p{x) = C[x'' ^ + 



q-1 



with C 



Xo{l-q) 



1 

9-1 



Where we have taken Ai = 1. Taking the hmit q ^ 1 inside the integrals we apply the 
first condition giving: 



lim / p{x)dx = 
The third condition gives: 



/ lim p(x)dx = C . — = I 
Jo 9-1 V A2 

1 



lirn lnq{x)p'^{x)dx 



2\T 2A2 



(2.10) 



The generalized Log-Normal distribution and the escort probabilities are the same: 



-fesc(3^) 



A2 



9/2 \ 

[^9-1 + ^ ^^9-1 _ if 11^ 



q-\ 

VxG/=(0,l), gG(l,2) 
Taking the limit (7 — > 1 in this expression and using 2.10 we get: 

1 



(2.111 



axy iTT 

which is the Log-Normal distribution. 



exp 



In^ X 
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2.5 Generalized Normal Distribution: / 

The constraints are: 



-oo, oo 1 



1. J^^p{x)dx = 1 2. f°°^xp'^{x)dx = 3. J^^x'^p''{x)dx = a'^ 
We need to maximize: 

/oo /"OO fCO 

p{x)dx — Ai / xp'^{x)dx — A2 / x'^p''{x)dx 
-00 J —00 J —00 

-Xo{l-q) 



1 

9-1 



thenp{x) = C[l + Xix{q - I) + X2x'^{q - I)] 9-1 C 

If we take the limit g — > 1 for p{x) we get: 

lim p{x) = Ce-^i^e-^2x2 

q^l 

If we choose Ai = we obtain the same results as for the Normal distribution, and the 
escort probabilities and the distribution ar the same: 



Pe.c(x) = y^[l + A2x2(g-1)]"^ 



(2.12) 



Is easy to verify that the limit of this expression is the Normal Distribution with null mean 
value. 

2.6 Generalized Laplace Distribution: I = (—00,00) 
The constraints are: 

1. f^^p{x)dx = 1 2. f^^\x\p'^{x)dx = w 
We need to maximize: 

/oo fOC 
p{x)dx — \i j \x\p'^{x)dx 
-00 J —00 

"Ao(l-g) 



p{x) = C[l + Xi\x\{q-l)]^ with C 



1 

9-1 



Taking limit: 



/oo 
-00 



p{x)dx 



00 

lim p[x)dx - 
-00 9-*! 

2C 



A 



1 then C 



Ai 
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This reproduces the known behavior of Laplace distribution. The escort probabihties and 
the distribution are the same: 



Conclusions 

We have obtained mainly these results for the Tsallis entropy and we have shown that 
the use of Renyi entropy does not imply any new result because generalized versions are 
almost the same differing in a constant value. The generalized versions of the continuous 
statistical distributions depend on the parameter g S M as the Tsallis entropy does. In the 
limit g — > 1 we obtain the BGS entropy from the Tsallis generalization and so it happens 
with generalized versions of distributions where we can obtain the classical distributions 
using the same limit. The application of this procedure to other statistical distributions 
is straightforward. 

The application of these generalized distributions to physical situations should be of inter- 
est and we hope they can be found very quickly. In particular, Brouers and Sotolongo [6] 
derived the dipolar relaxation function for a cluster model whose volume distribution was 
obtained from the generalized maximum Tsallis nonextensive entropy principle relating 
the power law exponents of the relaxation function to a global fractal parameter a and 
for large time to the entropy nonextensivity parameter q. 
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With the second condition we obtain: 
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